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ABSTRACT 


Isis  ■ one  of  a eerie*  of  papers  concerned  with 
the  psychophysical  application  of  the  Mathematical  theory 
of  signal  detectability.  This  paper  brings  together  all  of 
the  data  on  visual  detection  collected  to  date  that  bear 
directly  on  the  case  of  the  signal -known -exactly  as  treated 
by  the  theory  of  signal  detectability.  The  general  conclu- 
sion drawn  from  the  experimental  results  reported  is  that 
the  nodel  provided  by  the  theory  of  signal  dateateblllty  or, 
■ore  generally,  by  the  theory  of  statistical  decision,  is 
applicable  to  the  visual  detection  behavior  of  the  hunan 
observer.  That  is  to  say,  the  huaaa  observer  is  capable  of 
ordering  values  of  the  variable  upon  which  detection  depends 
well  below  the  threshold  level  as  this  level  is  conventionally 
conceived.  Further,  the  experiments  show  the  observer  to  be 
capable  of  behaving  in  accordance  with  several  klm*  of  opti- 
ma decision  as  defined  within  the  theory  of  signal  detecta- 
bility. The  general  ij^licatlone  of  the  applicability  of  the 
model  for  sensory  theory  and  psychophysical  Methods  are 
discussed. 
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ns  imna  tor  a decision-mucho  theory  of  visial  detection 

i.  introduction 

This  Is  on*  of  a series  of  papers  concerned  with  the  psychophysical 
application  of  the  aatheaatical  theory  of  signal  detectability.  This  Introductory 
section  contains  a short  discussion  tt  the  references  in  which  the  theory  of  sig- 
nal detectability  is  presented,  and  also  contains  references  to  other  papers  in 
the  series  on  the  psychophysical  application  of  the  theory  of  signal  detectability. 
There  follows,  in  this  introductory  section,  a brief  deecripwlon  of  the  theory  of 
elgnal  detectability  and  of  the  theory  of  visual  detection  based  on  it,  and  an 
outline  of  the  scope  of  discussion  of  the  present  paper. 

1.1  Related  Articles 

"The  Theory  of  Signal  Detectability,"  by  Peterson  and  Birdsall,  appears 
as  Technical  Report  No.  13  of  the  Electronic  Defense  Oroup  of  the  bhi varsity  of 
Kichi^n  (Ref.  15).  Technical  Report  No.  19,  by  Pox  (Ref.  8),  contains  a non- 
nathsantlcal  discussion  of  the  ssterial  of  Technical  Report  No.  13  on  the  general 
theory  of  detectability,  ss  veil  as  a discussion  of  the  nethods  employed  in  se- 
quential observation  processes.  Birdsall '■  Technical  Report  No.  20  (Ref.  2)  pre- 
sents an  application  of  gum  theory  to  signal  detectability.  The  aster! »1  of 
Reports  13  and  19  Is  also  available  in  the  "Transactions  of  the  I.R.E.  Profes- 
sional Oroup  on  Infoimticm  Theory",  (Ref.  16). 

The  application  of  the  theory  of  signed  detectability  to  visual  detec- 
tion by  the  h\aan  observer  vas  first  r*,orted  by  Tanner  and  3vetc  in  Technical 
Report  No.  10  of  the  Electronic  Defense  Oroup  (Rsf.  22).  This  topic  is  also  dis- 
cussed elsewhere  (Refs.  19,  23>  24).  The  aost  readily  available  source  containing 
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a report  of  some  of  this  work  is  the  Psychological  Rerlaw  of  loveefeer , 195^  (Ref . 
23).  A paper  la  tha  "Transaction*  of  tha  I.R.I.  Professional  Qroip  on  Information 
Theory"  (Ref.  I)  contain*  a report  of  the  work  of  Tanner  and  Herman  relating  the 
theory  of  signal  detectability  to  auditory  detection. 

Several  other  paper*  in  this  eerie*  are  currently  being  prepared.  Tech- 
nic*.! Report  Bo.  30  by  Tanner,  8wet*,  and  Green  (Ref.  26)  i*  another  paper  relat- 
ing the  theory  to  data  from  auditory  experiment*.  Technical  Report  *0.  k2  by 
Tanner,  Birdsall,  and  Swots  (Ref.  20)  deal*  with  the  implication*  of  thi*  re- 
search for  method*  and  analysis  procedure*  in  psychophysical  testing. 

The  present  paper  brings  together  the  data  on  visual  detection  collected 
to  date  that  bear  direct^  on  the  case  of  the  signal-kncvti- exactly  as  treated  by 
the  theory  of  sigasl  detectability.  Same  of  these  data  hare  been  reported  pre- 
viously only  in  relatively  inaccessible  sources  (Refs.  19,  22,  23,  and  24 ) j seem 
of  the  data  that  were  reported  in  a more  available  source  (Ref.  25)  were  only 
briefly  described  there.  In  addition,  soma  of  the  data  presented  below  have  not 
been  previously  reported  in  any  form.  It  is  the  primary  purpose  of  this  paper  to 
present  all  relevant  available  data;  although  the  theory  of  signal  detectability 
and  the  theory  of  visual  detection  based  on  it  are  reviewed,  they  are  not  dis- 
cussed cusp  lately,  and  vhereas  the  general  implications  for  sensory  theory, 
methods,  and  data  analysis  are  dr  m,  they  are  not  treated  here  In  full  detail. 

. .2  A Decision-Making  Theory  of  Visual  Detection 

In  this  section,  the  theory  of  signal  dstectabiiity  is  reviewed  as  it 
relates  to  the  problem  of  visual  detection  by  the  himma  observer.  It  should  be 
pointed  out,  by  way  ' introduction,  that  th  theory  of  signal  detectability  is 
derived  directly  from  the  theory  of  statistical  decision  the  theory  of  testing 
statistical  hypotheses.  This  latter  theory  is  presented  most  completely  by  Maid 
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(Ref.  Jf>);  important  papers  published  earlier  include  tboee  by  v*sld  (tot.  27), 
toymn  (tot.  13),  and  Meyean  and  Pearson  (Rtf.  lW). 

1.2.1  The  Fundamental  Pr^olee.  The  fwdaaetttal  pr<  «a  in  signal  detec- 
tability irvolves  a fixed  observation  interval;  the  observer  > pretested  a 
"receiver  input”,  a function  of  ti«e  tor  I seconds.  Fe  1-  ?**  . . aaLad  to  decide, 

on  ""he  basic  of  the  observation,  whether  that  receiver  is  yJt  arose  fro*  nolee 
alone,  or  fra  signal  plus  noise,  where  the  signal  ie  *nown  to  be  fro*  a certain 
ensemble  of  signals. 

Tais  problem  has  an  exact  parallel  In  vlS’Al  psychophysics.  Hm  obser- 
ver  in  th»  most  cemscu  visimi  psychophysical  experiment,  an  experlaest  employing 
the  so-called  yes-nc"  Method,  is  asked  to  observe,  at  a particular  tine  and  a 
pertlcular  location  in  the  visual  field,  a signal  of  a particular  else,  duration, 
and  Intensity.  Ordinarily  the  site  and  duration  of  the  signal,  as  well  as  It* 
location  and  tine  of  occurrence,  are  known  by  the  observer;  in  certain  i«--«uices, 
information  about  the  intensity  of  the  signal  and  the  a priori  probability  cf 
sign*!  occurrence  are  also  provided  the  observer.  He  i*  then  asked  to  state,  on 
the  basis  of  the  observation,  whether  or  net  a signal  was  presented. 

1.2.2  Assumptions  Mule  in  Applying  the  Theory  of  Signal  Detectability 
to  the  Behavior  of  the  Human  Observer . Given  certain  asova^tions,  asking  vhe  ob- 
server in  a psychophysical  experiment  to  state  whether  or  net  a signal  was  pr*. 
serted  1*  equivalent  to  asking  hi»  to  decide  whether  Lis  observation  arose  fro* 
signal  plus  noise  or  from  noise  alone,  or  stated  another  way,  to  decide  whether  or 
uot  to  accept  the  hypothecs  that  a signal  existed.  The  primury  assiMptioa  is  that 
the  value  of  the  variable  which  detection  depends,  presimably  neural  activity, 
vai  ie*  f~o«  Instant  to  instant  in  a random  fashion  when  nc  signal  is  present,  eut 
that  the  value  cf  this  variable  produced  by  a signal  of  given  strength  1st.  30 
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readonly  distritmted.  Although  there  is  no  need  to  conceptualize  this  variable 
in  neurophysiological  terms,  it  may  be  helpful,  and  the  assumption  stated  is  sug- 
gested by  present  Knowledge  of  neurophysiology.  So  it  may  be  maintained  on 
a priori  grounds,  that  if  the  problem  - C visual  detaction  is  the  detection  of 
sigLils  having  randomly  distributed  neural  effects,  in  the  presence  of  a back- 
ground of  random  interference,  then  the  theory  of  statistical  decision,  or  in  par- 
ticular, the  theory  of  signal  detectability,  constitutes  & model  of  poaa  ie  rele- 
vance to  visual  detection. 

An  attempt  to  apply  the  theory  of  signal  detectability  to  human  be- 
havior, therefore,  implies  the  assumptions  that  the  sensory  systems  function  pri- 

i 

marily  to  transmit  information,  and  that  the  sensory  systems  are  noisy  channels. 

An  additional  assumption,  made  apparent  in  the  following  pages,  is  that  the  cen- 
tral mechanisms  involved  in  decision  making  are  capable  of  making  optimal  use  of 
the  information  transmitted  by  sensory  paths. 

It  is  assumed,  then,  that  the  observer  operates  with  a continuous 
variable,  the  values  of  which  constitute  "observations,"  aod  that  any  value  of 
this  variable  may  arise  either  from  noise  alone  or  from  signal  plus  noise.  It  is 
assigned  that,  when  the  signal  ensemble  is  known  to  the  observer,  the  probability 
that  a given  observation  represents  noise  alone,  and  the  probability  that  this 
value  arose  from  the  signal -plus-noise  distribution,  can  be  estimated  by  him. 

Thus,  it  is  assumed  that  the  observer  in  a 'ye  a -no"  experiment  must 
establish  a level  of  confidence,  or  criterion,  and  base  his  decision  on  the  rela- 
tion of  the  observation  to  this  criterion. 

1.2.3  The  Definition  of  Criterion  and  Likelihood  Ratio.  According  to 
the  theory,  the  observer  chooses  a set  of  observations  (the  criterion  A)  such  that 
an  observation  in  this  set  will  lead  him  to  Accept  the  existence  of  a signal;  that 
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i£>  the  ch  jsmr  accrpt.  the  hypothesis  that  signal  pin#  noise  existed  dvxin*  tha 
observation  lntervel  All  other  observations  are  in  the  Cosy  lament  of  the  cri- 
terion, CA;  thee#  are  regarded  by  the  obeenrer  ee  representing  noit.i  alone.  8B 
will  be  ueed  to  denote  signal  plu*  noise  and  S will  denote  note*  alone . If  t ter  re 
are  only  a countable  number  of  possible  observations,  each  observation,  x,  having 
probability  Pgg(x)  of  occurrence  if  there  is  signal  plus  noise  present,  and  prob- 
ability p_(x)  of  occurrence  if  noise  alone  is  present,  then  the  likelihood  ratio 

n 


is  defined  as  i(x)  •>  F (x)/P  (x).  Sere,  x will  be  considered  continuous,  sad 

8?  n 


probability  density  functions  (frequency  functions)  fggU)  sad  fg(x)  ***  u*«d5 


accordingly  L(x)  « f (x )/f„(x).  It  is  assumed  that  for  every  x the  observer  can 


estimate  l(x)  which  is  the  relative  likelihood  that  x arose  fro*  signal  plus  noise 
as  compared  to  the  possibility  that  x arose  fro*  noise  alone. 

A criterion  may  be  evaluated  in  tame  of  the  integrals  of  the  density 
functions  over  the  criterion  A,  since  the  integral  of  fSB(x)  A is  the  con- 
ditional probability  of  detection,  Pg^A),  •°4  the  integral  of  ff(x)  over  A is  the 
conditional  probability  of  a falee  alarm  (a  Type  I error  in  statietical  parlance), 


P^A). 


1.2.4  The  Essence  of  the 


r.  The  essence 


of  the  theory  of  signal  detected  Uty  is  the  definition  of  a class  of  criteria  in 
terms  of  likelihood  ratio.  Under  each  of  several  definitions  of  the  optima  cri- 
terion, the  optimum  is  found  to  be  in  this  class  of  likelihood-ratio  criteria.  A 
criterion  in  this  class  is  denoted  A(p)j  that  is,  tbs  criterion  A contains  all 


observations  with  likelihood  ratio  greater  than  or  equal  to  p,  end  none  of  those 
with  likelihood  ratio  less  than  P.  The  solution,  then,  with  respect  to  a given 


definition  ci  optima,  is  the  exact  value  of  P to  be  used,  p is  defined  as  the 


operating  level  of  the  likelihood-ratio  receiver. 
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It  ta  noted  that  tbs  theory  of  signal  detectability  specifies  j 

oa  ths  optima  racsivar  that  receiver  wboee  output  is  either  li-alihood  ratio  or 
sene  mono tonic  function  of  likelihood  ratio.  If  the  output  of  the  receiver  is 
likelihood  ratio,  then  the  solution,  for  each  definition  of  optima,  is  the  cri- 
terion with  the  proper  operating  level  0-  If  the  receiver's  output  la  cone  de- 
cision function  other  than  likelihood  ratio,  hut  a nonotonic  function  of  llkell- 
hoci  ratio,  then  the  optima  operating  L/vel  ii  th~  va'ue  of  the  onotoLlc  Junc- 
tion at  p.  That  is,  if  the  receiver  output  is  tore  function  d(x)  ■ f[  <(«)]  > 
where  F is  strictly  nonotonic,  then  the  optima  criterion  is  specified  b” 
p*  - F(p),  such  that  d(x)2:  p'~l(x)i  p.  Thus,  the  theory  of  signal  deieeU- 
bility  way  describe  the  behavior  of  the  fcnmea  observer  if  the  human  observer 
operates  with  a continuous  variable,  or  decision  function,  that  is  either  likeli- 
hood ratio  or  seme  isoco tonic  function  of  likelihood  ratio.  j 

1.3  Scope  of  Discussion  j 

Peterson,  Birds all,  and  Fox  (Ref.  16)  advance  six  definitions  of  optima 
and  their  solutions.  Experiments  have  been  performed,  end  are  reported  in  the 
next,  three  sections  of  this  paper,  to  test  the  ability  of  the  human  observer  to 
act  in  accordance  with  three  of  these  definitions  of  optima.  Thee*  three  defi- 
nitions of  optimum  end  their  respective  solutions  are  listed  here. 

1.  Expected -Value  Criterion  — that  criterion  that  soxlmls**  ti  total 
expected  value,  where  the  individual  values  a~e: 

V  . - ths  value  of  a detection 

SJf-A 

V - ths  value  of  a correct  n 'action 
E’CA 


K 

an- 


CA 


the  coat  of  a miss 


the  cost  of  a false  alarm 


mmtmm  research  institute  • univewity  of  MfCXttA* 


P<») 

Solution;  A(p)  - 


Vca  * *W»A 
Wa  * ^i.CA 


where  P(n)  and  P(SN)  are  the  a priori  probabilities. 

2.  The  Heynan-Pe arson  Criterion  — that  criterion  auch  that  Pgg(A)  is 
a maximum,  while  Pr(A)S  k . 


r 

! 

I 


Solution:  A(p)  where  Pjf[A(fS.)]  «=  k 

3.  A Posteriori  Probability  — not  a criterion  but  the  best  estimate  of 
the  probability  that  the  observation  arose  from  sigu^l  plus  noise. 


PX(SB) 


i(x)  P(8H) 


i(x)  P(SR)  + P(K) 

Othei  definitions  of  optimum,  not  considered  explicitly  here,  for  which  the  solu- 
tion has  been  provided  (Ref.  16)  Include  the  Weighted-Combination  criterion,  the 
criterion  that  maximizes  Pg^A)  - w Pjj(A);  Siegert's  Ideal  Criterion,  the  criterior 
that  minimi  res  total  error;  and  the  Information  Criterion,  the  criterion  that 
maximizes  the  reduction  in  uncertainty,  in  the  Shannon  sense  (Ref.  18),  as  to 
whether  or  not  a signal  was  sent.  It  should  be  pointed  out,  however,  that  the 
Weighted -Comoination  Criterion  1b  the  abstract  criterion,  of  which  the  Expected- 


Value  Criterion  sad  Ideal  Criterion  a*«  special  cases.  The  Expect*  »d- Value  Cri- 
terion is  identical  to  the  Weighted-Combination  Criterion  for  the  case  where 
w 0 and  is  identical  to  the  Ideal  Criterion  for  the  case  where 

V«  ' *EA 
■ ■ — ■ - — * 1 

VSH*A  1 %*CA 
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The  fifth  section  of  this  paper  contain*  the  result#  of  an  »--peri*ent 
designed  to  determine  the  congruence  of  the  behavior  of  the  human  observer  and 
the  definition  of  optimum  behavior  for  the  forced-choice  situation,  a definition 
of  optimum  that  is  not  treated  explicitly  in  the  theory  of  signal  detectability. 

1,4  The  Incompatibility  of  a Decision-risking  Theory  of  Visual  Detection  and  Con- 
ventional Sensory  Theory 

Anticipating  to  an  extent  that  vill  facilitate  subsequent  description: 
the  primary  result  of  all  the  experiments  performed  is  that  the  theory  of  signal 
detectability,  or  more  generally,  the  theory  of  statistical  decision,  is  applica- 
ble to  the  behavior  of  the  human  observer.  That  is  to  say,  the  experiments 
demonstrate  that  the  hwan  observer  operates  with  a decision  function  that  is 
either  likelihood  ratio  or  some  monotonic  function  of  likelihood  ratio,  and  that 
the  human  observer  tends  to  behave  optimally. 

This  result  implies,  of  course,  the  ability  to  discriminate  among  obser- 
vations, or  values  of  the  decision  function,  that  may  result  from  noise  alone. 
Thus,  if  a threshold  (fixed  operating  level)  exists,  this  threshold  is  low  enough 
to  be  exceeded  by  noise  alone  an  appreciable  portion  of  the  time.  The  concept  of 
a threshold  that  Is  exceeded  more  than  very  rarely'  by  noise  alone  is  quite  differ- 
ent from  the  concept  of  threshold  that  is  an  integral  part  of  conventional  sensory 
theory. 

The  primary  purpose  of  this  paper  is  the  presentation  of  data;  hence, 
this  Is  not  the  place  to  attempt  a detailed  discussion  of  the  notion  of  a thresh- 
old as  it  appears  is  sensory  theory.  Tt  nay  be  well,  however,  to  adduce  one  or 
two  instances  of  current  methods  in  sensory  experimentation  In  order  to  support 
the  statement  that  the  threshold  as  conceived  in  sensory  theory  is  a relatively 
fixed  level  that  is  rarely,  if  ever,  exceeded  by  noise  alone. 
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Many  studies  of  ssnaory  processes  do  not  employ  trial*  in  wixish  no  sig- 
nal la  presented.  In  these  eases,  it  la  elsarly  not  regarded  a.  Important  to 
asanas  tbs  probability  that  the  fixed  level  be  exceeded  by  nolee  alone.  In  other 
studies,  the  experimenter  may  oceaalonally  Insert  one  or  tvo  trials  in  vhlch  no 
signal  Is  presented  (or  oceaalonally  turn  off  a continuous  signal)  In  order  to 
detect  «hat  are  regarded  as  spurious  responses,  so  that  ha  may  caution  the  obser- 
vers against  such  responses.  Such  trials  have  been  referred  to  as  vexlrfahlen, 
a term  which  nay  be  reasonably  translated  as  "catch  signals”.  A refinement  of  the 
procedure  In  which  catch  signals  art  sporadically  presented,  one  that  Is  used 
rather  frequently,  le  to  fall  to  present  signals  on  s larger  proportion  of  trials 
In  order  to  assess  quite  accurately  the  extent  of  "yes"  responses  on  such  triads. 
Then,  however,  not  only  is  this  information  subtracted  from  the  data,  but  the 
extent  of  "yes"  response  to  catch  signals  is  used  in  estimating  the  mount  of 
"spurious"  responses  made  to  actual  signals  so  that  these,  too,  msy  be  eliminated 
from  the  data.  This  use  of  the  correction  for  chance  In  psychophysical  experi- 
ments has  been  described  in  Ref.  25.  Regarding  the  totality  of  "yes"  responses 
to  catch  signals  as  spurious,  and  regarding  such  spurious  responses  to  be  equally 
likely  for  all  values  of  signal  intensity,  is  valid  only  If  the  threshold  level 
le  such  that  it  is  exceeded  by  noise  alone  on  a negligible  proportion  of  the 
trials. 

The  validity  of  the  supplication  of  the  chance  correction  to  psychophysi- 
cal data  depends  upon  the  validity  of  the  assxxqptlon  that  "yes"  responses  to  catch 
signals  are  spurious  responses,  or  randan  guesses,  and  that  these  responses  are 
Independent  of  "sensory-determinate"  responses.*  The  theory  advanced  here,  on  the 
other  hand,  assumes  a dependence  between  the  conditional  probability  that  an 
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observation  arising  from  signal  plus  noise  will  be  in  the  criterion  and  the  con- 
ditional probability  that  an  observation  arising  from  noise  alone  will  be  in  the 
criterion. 

The  data  presented  in  this  paper,  to  the  extent  that  they  are  analyzed 
in  this  paper,  do  not  indicate  hov  far  lawn  into  the  noise  the  observers  actually 
ordered  their  observations,  that  is,  how  low  relative  to  the  distribution  of  ob- 
servations arising  from  noise  alone  a fixed  threshold  oust  be  to  be  compatible 
with  the  data.  It  may'  be  the  case,  then,  that  further  analysis  will  show  the 
present  data  or  new  data  to  be  consistent  with  a fixed  threshold,  say,  at  the  mean 
of  the  noise  distribution,  a threshold  exceeded  by  noise  alone  approximately  50 
percent  of  the  time.  It  can  be  stated,  on  the  basis  of  completed  analyses  of  the 
present  data  which  are  to  be  reported  in  a paper  which  considers  and  evaluates 
several  alternative  models  (Ref.  20),  that  a fixed  threshold,  if  one  exists,  must 
be  lower  than  plus  one  slgna  from  the  mean  of  the  noise  distribution,  that  is, 
must  be  exceeded  by  noise  alone  more  than  16  percent  of  the  time.  It  is  import ant 
that  the  reader  note  that,  unless  specifically  stated  otherwise,  further  refer- 
ences in  this  paper  to  the  threshold  refer  to  e threshold  in  the  conventional 
sense,  that  is,  to  a threshold  exceeded,  to  be  :onservativ» , less  thin  5 percent 
of  the  time  by  noise  alone.  The  experiments  were  designed  to  detect  a threshold 

at  approximate ly  this  level  if  one  existed. 

2.  THE  EXPECTED-VALUE  OBSERVER 


An  experiment  cot  <'erning  the  ability  of  the  human  observer  to  maximize 
the  total  expected  value  is  the  one  experiment  discussed  elsewhere  in  a readily 
accessible  source  (Ref.  25).  This  section  supplements  the  discussion  in  Reference 
25  in  that  it  presents  In  more  detail  the  data  that  were  necessarily  described 


only  briefly  there.  In  addition,  this  section  contains  the  previously  unpubliobed 
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results  of  further  experimentation  on  the  ftcpected- Value  Observer  that  is  superior 


in  certain  respects. 

The  analysis  of  data,  in  terns  of  the  theory  of  signal  detectability, 
takas  the  form  of  plots  of  vhat  are  called  ROC  curves  — Receiver  Operating 
Cbarac' '--latics.  An  ROC  curve  is  a plot  of  the  conditional  probability  of  detec- 
tion, ?3jj(A),  against  the  conditional  probability  of  false  alarm.,  Pg(A).  A com- 
plete curve  is  obtained  if  all  possible  values  of  operating  level,  or  (5,  are  con- 
side  i«d.  Peterson  and  Birds  all  (Ref.  13)  have  demonstrated  that  the  optimal 
operating  level  is  represented  by  a point  on  the  ROC  curve  where  lta  slope  is  9. 

The  typical  ROC  curve,  one  that  has  occurred  frequently  in  this  work, 

is  shown  in  Fig.  1.  Pre<iuently,  as  in  this  figure,  a family  of  ROC  curves  is 

plotted  with  signal  strength  as  the  parameter.  In  this  particular  case,  the 

parameter  is  d',  the  index  used  for  the  analysis  of  data  in  terms  of  the  theory 

of  signal  detectability.*  It  is  defined  as  the  difference  between  the  means  of 

the  noise  and  signal -plua-ooise  distributions  normalised  to  the  standard  deviation 

of  the  noise  distribution  that  Is,  4'  • ^ . Thus,  d'  can  be  conceived 

era 

X 

of  as  a standard  *oore,  an  - measure,  or  again,  it  nay  be  thought  of  as  a 
(output)  elgnal-to-noise  ratio.  A more  complete  description  of  4*  and  of  the  ROC 
curves  may  oe  found  elsewhere  (Refs.  13,  16,  20). 

If  a threshold  exists,  this  fact  is  immediately  apparent  from  the  ROC 
curves.  The  conventional  notion  of  a fixed  criterion  or  threshold,  in  the  termi- 
nology of  thie  paper,  implies  the  existence  of  a set  of  observations  leading 


1.  4'  is  essentially  a dependent  variable;  the  paper  on  psychophysical  methods 
(Ref.  20)  treats  expllclty  the  reasons  for  preferring  it  to  the  usual  dependent 
variable  in  psychophysical  experiments;  namely,  the  calculated  threshold  or 
minimum  detectable  signal.  The  primary  purpose  of  the  present  paper  is  to  pre- 
sent the  data  upon  which  the  re coarse  relations  made  in  the  paper  on  psychophysical 
methods  are  based. 


11 


til 


-k- 


* -•  . . „ 
. * r*.-  1—  i.,  >.*-  * , — t rt. 


0 


ENGINEERING  RESEARCH  IWTITCTE  - UNIVBtfITY  OF  MICHIGAN 


f / 

& 
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to  an  extremely  small  pr^bfcb:  llty  f false  alarm.  The  observer*  a criterion  in- 
cludes tbla  aet  and  or  mey  not  include  a random  selection  of  other  observations 
that  la,  "guesses".  'Vjb  KX  curve  in  .Ms  case,  as  pointed  out  elsewhere  (22,  25)1 
is  a straight  line  frr*  th e lfitt-hsal  .e-tical  axis  to  the  upper  right-hand  comer. 

2.1  Data  from  the  First  Experiment 

The  RX  curves  obtained  free  the  first  experiment  on  the  Ixpected-Value 
Observer,  the  experinent  discussed  in  reference  25,  are  displayed  here  in  figures 
2,  3,  ani  4.  five  values  of  signal  intensity,  including  the  tero-ln tensity  sig- 
nal or  "blank",  were  used  in  this  experinent.  It  nay  be  seen  from  an  examination 
of  thsse  plots  that  the  data  of  the  first  experinent  d not  provide  an  adequate 
definition  of  the  entire  curve.  A a a natter  of  fact,  even  in  the  region  where 
points  have  been  obtained  (roughly  from  Pg(A)  - 0 0 K/A)  - 50),  the  curve  la 

not  well  defined.  This  latter  inadequacy  may  be  c' u,  in  part,  to  the  small 
number  of  observations  per  point.  A second  factor  which  operated  to  cause  dis- 
persion of  these  points  was  the  day-to-day  variation  in  algnal  and  background 
intensities  which,  unnim  in  the  calculation  of  contrast  thresholds,  is  not  taken 
into  account  in  the  present  analysis.  The  effects  of  both  of  these  sourced  of 
variance  were  reduced,  to  s large  extent,  in  the  second  Expected-Value  experiment 
which  is  reported  be lev 

Althoufdx  entire  FX  curves  were  not  precisely  defined  by  the  data  from 
the  first  experiment,  these  data  are  entirely  adequate  for  the  purpose  of  dis- 
tinguishing between  the  predictions  of  a theory  based  on  the  model  provided  by 
the  theory  of  *l®ial  detectability  and  the  predictions  which  follow  from  the  con- 
cept of  a threshold  or  fixed  criterion,  the  purpose  for  which  they  were  used  in 
Inference  15.  It  Is  clear,  for  example,  that  the  straight  lines  fitted  to  the 
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data  in  Figures  2,  3,  tod  4 do  not  interact  the  upper  right-hand  corner  of  the 
graph,  aa  required  by  the  concept  of  a fixed  threshold.  These  straight  lino 
appear,  rather,  to  be  arcs  of  the  type  of  ROC  curve  pxedlcted  by  the  theory  of 
signal  fvtestabil:  ty.  The  data  displayed  graphically  in  figures  2,  3,  and  k are 
reported  acre  precisely  ir  Tables  1,  2,  and  3* 

On  days  1 through  3,  there  were  50  presentation*  per  day  of  each  value 
of  signal  intensity  including  the  tero- in  tensity  signal.  On  days  9 ough  12, 
there  were  60  presentations  per  day  at  each  intensity.  On  days  13  through  16, 
there  were  30  presentations  per  day  of  each  value  of  signal  Intensity  greater 
than  tero , and  180  blanks  per  day.  This  experiment,  like  the  other  experiments 
reported  in  this  paper , employed  a circular  target,  30  minutes  of  visual  angle 
in  diameter,  with  a duration  of  l/lOO  second,  on  a ten  foot -Lambert  background. 

The  more  general  aspects  of  the  ppoced'ire  sod  apparatus  involved  in  this  experi- 
ment and  the  other  experiments  reported  in  this  paper  are  discussed  in  Reference 
25  and  in  an  article  by  F'.ackwtll,  Pritchard,  and  Qhmart  (Ref.  4). 

Tables  1,  2,  and  3 also  contain  the  data  which  serve  as  a basis  for  the 
coefficients  of  correlation  that  are  reported  in  References  22  and  25  and  again 
below,  between  Py(A)  sod  calculated  thrs ahold.  The  implication  of  these  correla- 
tions la  the  ssess  as  the  implication  of  the  straight  lines  fitted  to  tbo  data  of 
figures  2,  3,  sod  4,  namely,  that  a dependence  exists  between  the  conditional 
probability  that  an  observation  arising  from  S5  will  be  in  the  criterion  and  the 
conditional  probability  that  an  observation  arising  from  !f  will  be  in  the  cri- 
terion — a condition  that,  as  described  elsewhere  (Refs.  22,  24,  25),  is  incon- 
sistent with  the  eoocept  of  threshold,  or  fixed  c-iterion. 

The  product -moment  correlations  for  the  three  observers  between  P ^(g) 
a.M  calculated  threshold,  based  on  the  twelve  sessions  involving  s payoff  matrix  j 
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TABUS  2 

YB8-J0  DATA  FOR  OBSERVER  2 IN  THE 


YES-NO  DATa  FOR  OBSERVER  3 IN  THE 
FIRST  EXPECTED -VALUE  EXPERIMENT 
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(Days  5-16),  aim  -37(»  - .245),  -60(p  - .039)  -*Bl(p  - *001).  For  Mm  three 
subjects  combined,  p - .0006. 

The  dependence  of  false-alara  rate  sad  calculated  threshold  is  also  il- 
lustrated, tnougb  somewhat  crudely,  in  Figures  5 sad  6.  These  plots  represent  the 
data  of  days  5-16  for  all  three  observer*.  The  portion  of  data  comprising  each  of 
cbs  cui res  was  selected  to  be  relatively  homogeneous  with  respect  to  F^(a).  Figure 
5 shows  the  raw  data;  the  proportion  of  positive  responses  is  plotted  as  a function 
of  £X,  the  signal  intensity.  Figure  6 shows  the  sane  data  after  application  of  the 
chance  correction;  here  the  calculated  threshold  (the  value  of  &L  corresponding  to 
the  corrected  proportion  of  .50)  is  seen  to  be  dependent  upon  Pj(a)  in  the  pre- 
dicted direction.  The  observer,  apparently,  can  adjust  his  criterion.  If  he 
operates  with  a lower  value  of  0,  the  proportion  of  correct  detections  will  he 
increased  by  an  amount  that  is  not  completely  eliminated  by  the  coincident  increase 
in  the  site  of  the  chance  correction  factor,  Pj|(A). 

2.2  Data  from  the  Second  Experiment 

Since  the  data  from  the  first  experiment  did  not  suffice  to  trace  out  e 
complete  ROC  curve,  a second  experiment  was  conducted  to  obtain  a broader  range  of 
values  of  Pg(A).  A different  set  of  observers  was  used  in  this  experiment,  and 
only  one  value  of  signal  Intensity  was  deployed.  The  data  for  the  four  observers 
are  shown  in  Figures  7 through  10.  Each  point  represents  a two-hour  observing 
session  including  200  presentations  of  signal  and  200  observations  in  which  no 
signal  was  presented;  that  is,  P (3N ) was  held  at  .50  throughout  this  second  experi- 
ment. Changes  in  0,  and  thus  In  P^A),  were  effected  entirely  by  changes  in  the 
relative  values  and  coq^t  with  which  an  Expected-Value  Observer  operates.  The  data 

t 

from  which  Figures  7 through  10  were  plotted  aie  presented  in  Table  4.  The  column 

t 
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FIG.  6.  RAW  DATA  CORRECTED  *tP  GHmNCC, 
AVERAGE  TOR  ALL  00 SCR VERS  IN  THE  FIRST 
EXPECTED-VALUE  EXPERIMENT. 
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Id  Table  k labeled  "Aeponooed  Optima#  Pf(A>"  will  be  Alectmeed  later  Id  tfcia  Mo- 
tion of  the  paper. 

It  any  he  omq  in  Pigurea  7 through  10  that  the  e^erlMsUlly  detenelaed 
point#  ere  reasonably  Mil  fitted  by  the  type  of  HOC  curve  predicted  by  the  theory 
eubecribed  to  here.  It  le  totally  appem**  that  point#  ere  not  Mil  fitted  by  n 
etmigh4  line  intersecting  the  point  Pf(A)  - Pfflf(A)  • 1.  It  le  important  to  note, 
in  this  connection,  that  the  theoretical  ROC  curve#  plotted  in  Figure#  7 through  10 
er#  not  exactly  the  #m#  ee  thoeo  plotted  in  figure  1.  The  exact  fore  of  the  theo- 
ry .cel  ROC  curve#  portrayed  in  figure  1,  m pointed  out  in  Reference  29,  le  depend* 
ent  upon  the  eeeueptlon  that  the  Attribution#  of  I end  8 ♦ I ere  Oaueelan  end  of 
equal  vnrleaoe.  It  we.  ^parent  at  the  tine  of  writing  of  Reference  29  thet  the 
aeauqptloii  of  equal  vmrlenoe  wee  not  entirely  adequate;  the  nature  of  the  variance 
assumption,  however,  wee  not  critical  for  the  purposes  of  that  paper,  and  the  equal' 
variance  m auction  wm  accepted  to  facilitate  enalyele.  the  theoretical  . irvee 
shown  here  in  figures  7 through  10,  which  are  fitted  quite  Mil  by  the  date  plot- 
ted there,  wore  dram  under  the  assumption  thet  the  ratio  of  the  inercMnt  in  the 
Man  to  the  inerewert  in  the  standard  deviation  is  equal  to  b.  The  implication  for 
analysis  procedures  of  a dependence  between  signal  strength  end  variance  is  dis- 
cussed in  tbs  paper  on  net  hods  (Rtf.  20). 

2.3  The  Approach  to  tha  Cptlmm  Behavior 

The  fact  that  the  data  obtained  in  the  two  Kxpected-Value  experlwent#  is 
fitted  non  adequately  by  the  type  of  ROC  curve  coo# latent  with  the  theory  of  sig- 
nal detectability  than  by  the  straight-line  ROC  curve  consistent  with  the  fixed 
threshold  notion  iaglies  that  the  husan  observer  can  vary  his  criteiion.  The 
qiwstlon  rs wains  as  to  how  closely  be  approaches  the  opticus  criterion. 


I 
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To  establish  the  ^plicability  of  the  theory  of  sigal  dot* (nobility, 
it  is  necessary  to  Isnnstrsti  only  that  tbs  observer's  operating  level  is  seas 
aanotoolo  function  of  0.  When  sapling  error  Is  taken  into  account,  the  restric- 


tion is  aore  lenient)  in  this  ease,  it  is  sufficient  to  demonstrate  a significant 
correlation  between  the  ooaerver'a  opiating  level  and  0.  It  ie  interesting, 


hoetver,  to  determine  hoe  closely  the  observer's  operating  level  approaches  that 


specified  by  0. 


In  the  first  experiment,  the  observers  sere  informed  of  the  various 


values  taken  on  by  the  elements  of  the  0-equation  (see  page  6);  i.e.,  the  a priori 


probabilities,  *ha  values  sal  costs.  They  vers  not  made  aware  of  the  way  in  which 


these  elements  determine  a value  of  0,  nor  did  they  know  that  the  single  number, 


0,  taken  in  conjunction  with  an  ROC  curve,  yield*  the  optima  false -alarm  rate. 


Thsy  were  informed,  after  each  experimental  session,  of  their  felee-alarm  rate,  the 


proportion  of  correct  detections  of  tech  of  the  four  signal  intensities,  and  the 


payoff.  The  correlations  obtained  in  this  study  between  0 and  false -alarm  rate 


indicate  that  these  observers  tended  toward  the  optima  setting  of  the  criterion. 


for  the  three  observers,  the  rank-order  correlations  were  .70,  .46,  and  .71;  a 


correlation  of  .68  ie  significant  at  the  .01  level  of  confidence. 


The  first  stud}’  demonstrated  that  the  human  observer  quit#  naturally 


adjusts  hie  criterion  in  a way  approaching  optima.  With  this  as  background,  the 


second  experiment  was  performed  with  the  observers  having  a fairly  coaplete 


knowledge  of  Its  purpose*.  The  second  study  attempted  to  determine  how  closely 


tbs  observers  could  approximate  the  optima  false -alarm  rate,  a*  specified  by  p, 


given  a knowledge  of  It.  Hence  the  column  in  Table  k labeled  "Announced  Optimum 


Pn(A)"-  Tbs  experimenter's  ability  to  announce  a value  of  PR( A ) approaching  the 


-optimum  value,  before  the  POC  curve*  of  the  observer*  had  been  determined  directly, 


— c- 
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depend*  upon  tba  fact  that,  u reported  la  reference*  88  and  25,  foroed-chotee  and 
yea-no  response  prooaduraa  yield  consistent  valuta  of  A'.  The  obaarvara  la  the 
second  study,  Ilka  those  la  tba  first,  had  baaa  trained  under  tba  foraed-eholoe 
procedure,  so  aatlaataa  cf  d'  vara  available. 

A ccrparlaoo  of  tba  coltssn  la  Ta^la  k laballad  "Announced  Optima*  F^(A)" 
and  tba  coluans  containing  tba  Pg(A)  obtained  froa  aaeb  obaarvar  ladlost*  boa  tall 
tba  obaarvara  xaproducad  tba  valua  armour  rad  as  optimal.  Tbs  rank -order  correla- 
tions between  tba  aanouaoad  optimal  and  obtained  valua  a of  Py(A)  a.  .94,  .97,  .66, 
and  .96.  Two  0'  tba  observers  served  la  twelve  see e loos;  tba  other  two  served  la 
thirteen  sessions.  Tba  rank-order  coefficient  associated  vltb  a probability  of 
.01,  given  twelve  pairs  of  awes  urea,  la  .66.  In  this  study,  the  obaarvara  ware 
Informed  cf  their  proportion  of  false  alarms  after  each  grotqp  of  fifty  trials. 

Tbs  study  of  the  Peyaan-Peeurson  Observer,  reported  In  tba  next  section  of  this 
paper,  provides  additional  evidence  for  the  rather  remarkable  ability  of  tba  obser- 
ver to  reproduce  a given  false -alarm  rats. 

3.  TBB  KTYMAH-PLAKSCB  0B8EHVP 

3.1  Tbs  Approach  to  tbs  Announced  Ootlam  Valuv  of  Pg(A) 

A different  set  of  four  observers  served  in  this  experiment.  Tbs  obser- 
ver* were  lnforaed  of  the  a priori  probability  of  slpsal  occurrence  (P(S>)  - .78 
was  bald  throughout  tbs  experiment ) , but  Instead  of  operating  in  terse  of  value* 
and  costs,  they  attempted  to  satisfy  • restriction  plmoed  on  tbs  proportion  of 

false  alarms. 

The  restriction  on  tbs  proportion  of  false  alarms  took  tbs  fora  of  s 
j stipulation  for  th#  observer*  of  the  acceptable  number  of  "ye*’'  r**pcnae*  to  the 
| fourteen  "nc-*isnal " presentation*  in  each  block  of  fifty  presentation*.  The 
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observers  ««n  instructed  to  respond  positively  to  approximately  a oi  n ♦ 1 of  the 
fourteen  "no •signal”  presentations  (n,  for  the  four  successive  conditions  of  the 
experiment,  equalled  3,  0,  6,  and  9 respectively),  eo  that  toy  proportion  of  falee 
alaraa , across  seTeral  blocks  of  fifty  presentations,  within  a (Iren  range  of  .06 
satisfied  the  restriction.  A given  restriction  ca  Fy(A)  was  effectin  across 
eighteen  blocks  of  fifty  trials.  There  were  then  four  conditions,  each  with  a j 
different  acceptable  range  for  P^(A);  thus,  the  primary  data  consist  of  four  values! 

I 

of  Pg(A)  for  each  observer,  with  each  of  these  four  values  based  on  252  "no-ei*nal"j 
presentations.  The  acceptable  range  for  Pg(A)  for  the  four  coalitions  ere  shown 
se  colusn  headings  in  Table  5;  tbs  false -alara  rates  obtained  froe  the  four  obser- 
vers ^pear  as  cell  entries,  iote  that  the  largest  deviation  froa  the  range  an« 
nounced  as  acceptable  is  .Ob.  TLeee  data,  then,  alsc  suggest  that  the  observer  is 
able  to  vary,  and  quite  precisely,  the  cutoff  point  on  the  continuum  of  observa- 
tions . 

It  is  true  that  the  data  presented  in  the  previous  paragraph,  to  tbs 
extent  that  they  were  reported  there,  could  have  been  obtained  If  the  threshold 
concept  were  valid.  I*  the  observer  were  given  isnedlate  knowledge  of  correctness 
of  response,  any  false -alara  rate  could  be  »-?rcxlmet*d , for  exsaqpls,  by  saying 
"yes"  until  the  given  proportion  of  false  alarms  was  achieved  sad  then  saying  "no" 
on  the  rest  of  the  presentations.  This  would  entail,  however,  a severe  depression 
of  4' . In  this  study,  the  observers  were  given  knowledge  of  correctness  of  re- 
sponse only  after  each  block  of  *>0  presentations,  sad  the  values  of  d ’ wars  not  | 

depressed. 

3-2  Other  Aoelyeee  of  the  Data  of  thie  Study 

In  this  study,  twelve  values  of  signal  Intensity  were  used , In  eddltlon 
to  the  "blank"  or  "xero-inteas ity  signal'.  Tb.Ls  rsther  large  mmsber 
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values  was  employed  In  an  attest  to  define  more  adequately  the  shsp  of  the 
psychophysical  curve.  The  results  of  the  analytic  of  curve  shape  will  be  discus 
1"  the  paper  dealing  with  psychophysical  methods  (Ref.  20). 

The  nature  of  the  ROC  curves  resulting  free  this  study  cannot  be  ade- 
quote ly  determined  since  only  four  points  were  obtained  for  each  curve;  that  is, 
foi  each  value  of  d*  or  signal  intensity,  neither  can  the  degree  of  correlation 
oetween  Pn(a)  sad  calculated  threshold  be  estimated  since  only  four  pairs  of 
measures  were  obtained.  Thus,  the  results  of  this  study  could  not  stand  alone  as 
evidence  for  the  existence  of  a variable  criterion,  or  stated  more  generally,  as 
evidence  that  the  observ  r’s  decision  function  is  a mono  tonic  function  of  likeli- 
hood ratio.  It  is  believed,  however,  that  the  other  f-'ur  experiments  reported 
herein  are  sufficient  to  establish  this  point. 
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4.  TEE  A POSTERIORI  PROBABILITY  OBSERVER 


The  same  four  observers  who  served  in  the  second  Expected-Value  expert- 
mi  served  in  this  study  of  the  ability  of  the  human  observe!  to  report  a 
posteriori  proDabillty.  In  this  experiment,  P(SR)  - .50.  The  ta»k  posed  for  the 
observers  was  to  place  each  observation  in  one  of  six  categories  of  a postsrlorl 
probability.  Here  again,  the  ability  to  order  the  observations  down  into  the 
noise  1*  -equired. 

One  analysis  of  tbs  data  is  reported  in  Table  6.  The  categories  of 
a posteriori  probability  with  which  the  observers  verksd  bead  the  columns  The 
boundaries  of  the  categories  wars  chossn  in  conference  with  the  observers;  they 
believed  that  they  would  ba  able  to  operate  reasonably  with  this  particular  scheme. 
The  cell  entries  ehow  the  proportion  of  the  observations  placed  in  a given  category 
that  were,  in  fact,  observations  of  •igral-plue-rvcise;  note  that  each  of  the 
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obMmn  served  in  thrr.e  experimental  sessions.  Thun,  the  entry  in  the  upper 
I left-JMnd  corner  indicate*  that  20  percent  of  the  observations  plaoc*  in  the  low- 

est probability  category  by  Observer  1,  in  the  firet  session,  were  obeervntione  of 
slgoal-plus-noise;  29  percent  of  the  observation  placed  in  the  next  catesory  were 
observations  of  sigaal-plus-noiM,  and  to  forth.  In  nine  of  twelve  cases,  i.e., 
in  nine  of  the  twelve  row*  of  Table  6,  a rank-order  correlation  of  unity  exists 
between  the  estimated  a posteriori  probability  and  the  relative  frequency  of  obser- 
vations arising  from  signal -plus-noise,  indicating  an  ordering  of  observations . 
Bach  of  there  correlations  has  an  associated  probability  of  less  than  .05*  All 
of  the  three  cases  showing  a correlation  of  leas  than  unity  are  attributable  to  a 
single  observer.  Observer  3* 

l».l  The  Relationship  between  d(x)  and  l(x) 

It  is  possible,  using  the  data  from  this  experiment,  to  determine  the 

relation  existing  between  the  observer's  decision  function,  d(x)  and  likelihood- 

ratio,  i(x).  For  this  experiment,  with  P(SR)  - .50,  the  equation  for  a posteriori 

probability,  given  in  the  introductory  section  of  this  paper,  reduces  to 

PX(SH)  - jjy?}  i • Since  Pot(A)  and  Pr(A)  can  be  estimated  for  the  boundaries  of 

the  six  categories,  d'  can  be  determined.  A knowledge  of  Pr(a)  (relative  to  each 

boundary)  and  4'  allows  a graphic  determination  of  the  value  of  t(x)  corresponding 

to  each  boundary  since  the  critical  value  of  l(x)  for  a given  value  of  Pr(A) 

equals  the  slope  of  the  ROC  curve  at  the  point  which  corresponds  to  that  value 

of  P„(a).  Thus  PV(SH)  - /ill. — can  be  determined  for  each  operating  level 
H x J(x)  ♦ 1 

employed  by  the  observer.  The  values  of  Ux;  obtained  in  this  way  for  the 

l(x)  + 1 

observer  will  correspoiri  directly  to  the  probability  values  marking  off  the 
categories  — if  the  observer  is  operating  with  a decision  function,  d(x),  that  Is 
equal  to  l(x),  and  according  to  the  optimum  relation  between  Px(SIf ) and  l(x). 
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Figures  11,  12,  13,  and  14  show  plots  of  the  probability  values  corresponding  to 

l/yt 

boundary  categories  versus  Px(SX)  ■ ^ j ' ^ determined  from  the  data  for  the 
four  observers.  Observer*  1 and  2 appear  to  be  operating  with  d(x)  similar  to 
i(x)  and  approximately  according  to  knowledge  of  the  optima  relation  between 
PX(8U)  and  l(x).  Ale  result  should  probably  not  be  generalised  beyond  the  con* 
dltlon  of  P(3V)  ■ P(lf)  » 30.  It  should  be  remembered,  however,  that  the  obser- 
vers vers  exposed  to  this  teak  fur  ociy  lour1  experimental  sessions,  with  feedback 
after  each  session  limited  to  the  information  reported  in  Table  6.  With  respect 
to  Observers  3 and  4,  it  ij  no  clear  whether  they  are  operating  with  a d(x) 
quite  unlike  l(x),  or  with  an  imperfect  approximation  to  the  optimum  relation 
between  PX(SM)  and  d(x),  or  both. 

It  Is  possible  to  determine  more  exactly  the  relation  between  l(-)  and 
d(jr)  for  the  four  observers , The  observer's  decision  function,  d(x),  can  be  set 
equal  to  and  the  value  of  w determined.  Then  the  cutoff  values  of  PX(S>) 

used  by  the  observers  are  described  by 


pxm 
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where  p is  set  equal  to  the  boundaries  of  the  categories.  One  interesting  question 
is  whether  the  weights,  v's,  are  constant  for  each  observer.  The  values  of  w 
corresponding  to  each  category  boundary,  for  each  session  and  for  each  observer, 
sue  given  In  Table  7. 


Observers  1,  3,  and  4 reported  a posteriori  probability  in  a single  session 
pieced  ng  the  three  sessions  reported  In  'fable  6.  Since  different  categories 
were  used,  this  session  was  considered  as  practice,  and  tbs  data  excluded 
from  the  analysis. 
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PX(SN)  CORRESPONDING  TO  CATEGORY  BOUNDARIES 
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FIG.  13.  OBJECTIVE  PROBABILITY  VS. 
SUBJECTIVE  PROBABILITY  FOR  OBSERVER  3. 
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TABI2  7 — THE  HELATIOWSHIP  BETKEEI  d(x)  and  i(x)+ 


. Category 

N.  Boundaries 

Observer*--^ 
and  Day 

.05 

.20 

.40 

.60 

.80 

Day  1 

2.9 

mm 

n 

B9 

Obs.  1 Day  2 

3-2 

mm 

Day  3 

2.5 

1.6 

B 

B 

IB 

Day  1 

?-2 

2.2 

2.3 

wm 

Obs.  2 Day  2 

•95 

2.0 

3.5 

B 

Day  3 

1.9 

1.7 

1.9 

B 

Day  1 

5-3 

3.8 

0 

B 

Obs.  3 Day  2 

6.4 

2.6 

B 

Day  3 

4.0 

1.6 

D 

B 

•3 

Day  1 

28.5 

20.0 

... 

--- 

— 

Obs.  4 Day  2 

34.2 

36.0 

— 

— 

— 

Day  3 

30.4 

11.6 

6.9 

4.7 

— 

The  weights  for  sene  of  the  higher  categories  are  lode terminate 
since  the  critical  value  of  l(x)  approaches  Infinity  as  Pg(A) 
approaches  0.0. 
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To  determine  the  degi-ee  to  which  v approximates  a cone  tent  for  each 
session  and  each  observer,  a given  fixed  value  of  v can  be  chosen  for  each  obser- 
ver, and  used  to  determine  rx(SH ) *>  — — If  the  "true"  values  of  v are 

l(x)  ♦ v 

approximately  constant  for  a given  observer,  then  a plot  of  the  points",  represent- 
ing category  boundaries  versus  FX(SH)  ■ v (with  v fixed),  should  be  ade- 

quately fitted  by  a straight  line  intersecting  the  points  (0,0)  and  (1.00,  1.00). 
That  is,  each  of  the  lines  in  Figures  11  through  14  should  correct  to  the  diagonal. 
This,  however,  is  not  the  result.  Using  fixed  values  of  w resulted  in  a plot  cf 


points  for  Observers  1 and  2 that  are  only  slightly  better  fitted  by  the  diagonal 


line  than  are  the  points  shown  in  Figures  11  and  12.  A fixed  value  of  v greatly 
improves  the  correspondence  of  the  diagonal  line  and  the  plotted  points  for 
Observer  4 — for  Days  1 and  2.  The  correspondence  for  Observer  3 is  not  improved 
noticeably  by  the  transformation. 

It  may  be  noted,  however,  that  there  is  the  suggestion  (in  Table  7)  of 
a consistent  pattern  between  "subjective  probability"  and  "objective  probability" 
that  is,  of  a pattern  in  the  relation  between  v and  the  category  boundaries.  The 
w's  for  the  last  two  sessions  for  Observer  1 show  the  same  rank-order.  For  Obser- 
ver 3>  the  values  of  w rank  frou  left  to  right  for  each  of  the  three  sessions  with 
a single  exception. 


THZ  SSCOHD -CHOICE  KXPFRIXafr 


In  this  experiment,  a variation  of  the  forced-choice  method  of  response 


1 

!. 

P 


was  employed  to  demonstrate  the  ability  of  ths  observer  to  order  ooservationej. 


1 
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IT  This  experiment  was  suggested  by  K.  7.  Iforraan,  formerly  a member  of  the  Elec- 
tronic Defense  Group,  now  at  Princeton  University. 
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I 

In  the  version  of  the  forced-choice  method  most  conaonly  used,  ..he  observer  knows 
that  on  each  trial  the  signal  will  occur  in  one  of  four  short,  successive  time 
intervals,  and  he  Is  forced  to  choose  in  which  of  these  intervals  he  believes  the 
signal  occupred.  If  the  observer  can  order  observations,  then  to  behe.ve  optimally 
he  must  select  the  interval  with  the  greatest  associated  observation.  If  t h" 
observer  behaves  optimally,  then  the  probability  that  a correct  answer  will  re- 
sult for  a given  value  of  d',  for  the  four-choic-  or  four-interval  situation,  is 
given  by  the  equation: 

T>(r)  m / [f(x)]3  «t(x)dx  (1) 

-on 

where  F(x)  is  the  area  of  the  noi»e  distribution  and  g(x)  is  the  ordinate  f the 
signal -plus-noise  distribution.  The  vslue  of  P(c)  corresponding  to  each  value  of 
d‘  is  shown  by  the  middle  curve  of  Fig.  15.  This  curve  is  plotted  under  the  as- 
sumption that  the  distributions  of  R and  3 + R are  Gaussian  and  of  equal  variance. 

?.l  The  Rationale  fcr  the  Second-Choice  Experiment 

Consider  tbe  situation  where  the  observer  Is  required  to  indicate  a 
sec  nd  choice  as  well  as  a first  choi~e,  What  is  the  probability  of  a correct 
second  choice  on  those  trials  on  which  the  first  choice  is  incorrect! 

The  conventional  notion  of  a threshold  — - as  pointed  out  above  and,  It 
more  detsdl,  in  Reference  2?  — is  essentially  tbst  tbs  mechsnisa  of  detection 
is  one  that  triggers  when  toe  observation  exceeds  a critical  amount,  and  loses 
all  discrimination  among  observations  falling  short  of  this  saount.  For  the 
(four-choice ) forced-choice  sltuatl  n where  the  oberr-er  is  required  to  indi- 
cate a second  choice  as  well  as  a first  choice,  this  conce-tion  cf  the  mech- 
anism leads  to  the  prediction  that,  when  the  first  choice  is  incorrect,  the 
probability  tiiat  the  second  choice  will  be  correct  is  .33-  According  t-  thi9 
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view,  in  other  words,  the  second  choice  is  made  from  among  three  inta.-vala  on  * 
chance  ''aaia. 

On  the  other  hand,  according  to  the  conception  of  the  human  observer  aa 
operating  in  terms  of  likelihood  ratio,  the  observer  is  capable  of  ordering  the 
j four  observations  associated  with  the  four  intervals.  If  this  is  the  case,  the 
I proportion  of  correct  second  choices , on  those  trials  in  which  an  incorrect  first 
choice  is  made,  should  be  greater  than  . 33-  The  relationship  between  this  pre- 
dicted probability  d'  is  given  by  the  expression 

3/ ^F(x)]2  [l  - F(x)j  g(x ) dx 

-*» (2) 

1 - / [F(x)j3  g(x)  dx 

where  the  symbols  havj  the  same  meaning  as  in  Squat Ion  1 above.  This  relationship 
. a pi  tted  in  Figure  15  under  the  assumption  that  the  distribution  of  II  and  8 ♦ M 
are  Gaussian  and  of  equal  variance. 


.2  Results 


ua  were  collected  from  four  observers;  two  of  them  bad  served  pn> 
usly  the  acond  Expected- Value  experiment  whereas  the  other  two  had  only 
-eeeiv*!.  a':  -ie  forced-choice  training.  Eacn  of  the  observers  served  in  three 
experimented,  sessions.  Each  session  include!  150  trials  in  which  both  s first 
•uxl  second  choice  were  required.  The  resulting  twelve  proportions  of  correct 
second  choices  are  plotted  again**  d ' in  Figure  5-  The  vsdues  of  d'  were  deter- 
mined by  using  tim  proportions  of  correct  first  choices  as  estimates  of  P(c)  and 
readi"*.  the  corresponding  values  of  d'  fro*  the  middle  curve  of  Fig.  1).  Although 
a single  of  signal  intensity  vas  used,  the  values  of  d*  differed  sufficiently 

fro*  one  observer  to  another  to  provide  an  indication  cl  the  congruence  of  the 
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date,  with  the  predicted  functions.  Additional  variance  in  the  es.  .mates  of  d' 
reeulted  from  the  fact  that,  for  two  observers,  a constant  distance  from  the  sig- 
nal was  not  maintained.  (The  function  predicted  by  the  theory  of  siyial  detec- 
tability for  the  proportion  of  correct  first  choices  in  a three-choice,  or  three 
interval,  situation  is  included  in  Fig.  15  to  indicate  that  this  function  is  not 
the  sanx  as  the  predicted  function  or  the  probability  of  a correct  second  choice, 
given  an  incorrect  first  choice,  for  the  four-choice  situation). 

A systematic  deviation  of  the  data  from  a proportion  of  .33  clearly 
exists.  Considering  the  data  of  the  four  observers  combined,  the  proportion  of 
correct  second  choice'’  is  .46.  The  deviation  of  th4 * obtained  proportion  from 

p 

.33  is  highly  significant,  the  X obtained  (43  66)  is  rare  than  twice  the 
X2(19.0)  associated  with  a probability  of  .00001. 

Two  control  conditions  aid  in  interpreting  these  data.  The  first  of 
these  allowed  for  the  possibility  that  requiring  the  observer  to  make  a second 
choice  might  depress  his  first-choice  performance.  During  the  experiment,  blocks 
of  50  trials  in  which  only  a first  choice  wa * required  were  alternated  with  blocks 
of  50  tritla  in  which  both  a first  and  second  choice  were  required.  Pooling  the 
data  from  the  four  observers,  the  proportions  of  correct  fi;st  choices  for  the 
tvc  conditions  are  .650  axxi  .651,  a difference  that  is  obviously  not  significant. 

A preliminary  experlrmsnt  in  which  data  were  obtained  from  a single  ob- 
server for  five  values  of  sigDsd  intensity  also  serves  as  a control.  This  expert - 
i mcnt  substantiates  the  predicted  correlation  between  the  probability  of  a correct 
secor«i  choice  and  signal  intensity  that  derives  froa  the  theory  of  signal  detec- 
tability. 150  observations  were  made  at  each  value  of  signal  intensity.  The 
relativ-  frequencies  of  correct  second  choices  for  the  lowest  fo’u*  values  of  sig- 
nal intensity  were,  in  increasing  order  of  signal  Intensity,  2o/ll7  (.25:), 
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33/95  (.35)*  30/75  (.40),  and  20/30  (.67).  For  the  highest  value  of  signal  inten- 
sity, none  of  five  second  choices  were  correct.  Thus,  the  proportion  of  correct 
8-  'ond  choices  is  seen  to  be  correlated  with  a physical  measure  of  signal  inten- 
sity as  well  at  vlth  the  theoretical  measure  (d* ) — this  eliminates  the  possi- 
bility that  the  correlation  found  with  a constant  value  of  signal  intensity,  in- 
volving d'  as  one  of  the  variables  (Figure  15),  is  an  artifact  of  theoretical 
manipulation.  The  second-choice  data,  then,  demonstrate  clearly  the  untenability 
of  the  assumption  of  a fixed  criterion  or  threshold. 

It  may  be  seen  from  Fig.  ±5  that  second-choice  data  also  deviate  sys- 
tematically from  the  predicted  function  derived  from  the  theory  of  signal  detec- 
tability. This  discrepancy  results  from  the  inadequacy  of  the  assumption  — of 
equal  variance  of  the  noise  and  signal-plus-noise  distributions  — upon  which  the 
predicted  functions  in  Pig.  15  are  based.  It  was  pointed  out  above  and  in  Refer- 
ence  25  that  the  equal-variance  assumption  was  accepted  in  the  early  stages  of 
data  collection  in  order  to  facilitate  analysis,  in  spite  of  existing  indications 
of  its  inadequacy.  It  was  also  pointed  out  above  that  more  recent  data  on  the 
Expected-Value  Observer  (see  Figures  7-10  and  accompanying  text)  indicate  that 
a valid  assumption  would  be  the  assumption  that  the  ratio  of  the  increment  in  the 
mean  to  the  increment  in  the  standard  deviation,  is  equal  to  4.  Figure  16 
shows  the  second-choice  data  and  the  predicted  four-choice  and  second-choice  curve6 
derived  from  the  theory  of  signal  detectability  under  the  assumption  that 

m 

Vt  * 4.  In  view  of  the  variance  associated  with  each  of  the  points  (each  first- 
bolce  d'  was  estimated  on  the  basis  of  300  observations  and  each  second-choice 
proportion  on  less  than  100  observations)  the  congruence  of  the  data  and  the 
predicted  function  shown  in  Fig.  16  is  quite  remarkable. 
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5.3  A Note  on  the  Variance  Assumption 

The  particular  assumption  made  In  this  paper  about  the  variance  of  the  noise 
and  signs! -plus-noise  distributions,  namely  that  j-  ■ 4,  needs  qualification  in  two 
respects.  First,  it  is  very  likely  specific  to  the  experimental  conditions  em- 
ployed. Srcond,  il  is  to  be  regarded  as  only  provisionally  applicable  to  the 
present  data. 

If  the  variance  of  these  sampling  distributions  is  a function  of  sample 
size,  then  it  may  be  presumed  that  their  variances  are  different  for  different 
signal  durations,  or  observation  times,  and  for  sigials  of  different  sizes.  If 
the  variance  of  the  noise  and  signal-plus-noise  distributions  decreases  with  in- 
creases in  signal  size  and  duration,  then  an  assumption  concerning  the  increase  in 
variance  with  increasing  signal  intensity  1b  applicable  only  to  data  collected 
using  a single  duration  end  size  of  signal.  Since  the  various  experiments  re- 
ported here  employed  identical  signal  conditions,  it  was  possible  to  assess  the 
adequacy  of  a single  variance  assumption  for  different  forms  of  data,  for  rtyes-no" 
data  in  Section  2 and  for  forced-choice  data  in  Section  5-  Although  positive  re- 
sults were  obtained  from  this  check  of  internal  consistency,  it  should  not  be  in  - 
ferred  that  the  particular  assumption  will  describe  the  results  of  experiments  in- 
volving different  physical  parameters. 

AM 

I Also,  as  indicated,  that  the  assumption  that  — ■ 4 derives  from  the  data 

reported  ’sere  1 s advanced  with  certain  provisions.  Other  assumptions  have  not  beer 
thoroughly  explored.  It  may  be  that  ratios  equal  to  certain  other  constants  will 
fit  the  reported  data  even  better,  and  that  several  other  constant  ratios  will  fit 
the  data  as  well.  The  sensitivity  of  the  assumed  ratio  to  the  existing  data  has 
not  as  yet  been  determined.  It  is  likely  that  more  precise  data  is  required  for 
the  purpose  of  determining  the  relative  adequacy  of  different  variance  assumptions. 

These  problems  are  p .esently  being  explored;  the  results  will  be  reported 

in  the  paper  concerned  with  methods  of  data  analysis  (Ref. 20). 

50 
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6.  DISCUSSIOK 

The  general  conclusion  drawn  from  the  experimental  results  reported 
above  is  that  the  model  provided  by  the  theory  of  signal  detectability  (Refs. 

15,  1 6)  or  more  generally,  by  the  theory  of  statistical  decision  (Refs.  13>  lU,  27, 
28)  is  uppllcable  to  the  detection  behavior  of  the  human  observer.  Tills  model  will 
produce  data  like  those  observed. 

This  type  of  model  has  come  to  be  called  a "computer  model".  The  term 
"computer" , in  this  connection,  is  meant  very  generally;  it  Includes  anything  that 
processes  information  in  a precisely  defined  way.  Quastler's  discussion  of  the 
nature  of  the  computer  model  is  pertinent  here. 

"The  computer  model  may  be  a system  of  equations.  It  may  be  a 
black-box  diagram  with  boxes  labelled  'receiver',  'memory',  'trans- 
ducer', 'decision',  etc.  It  may  be  a piece  of  hardware.  It  may 
have  many  or  few  components;  it  may  be  determinate  or  stochastic, 
neither  the  size  nor  the  type  nor  the  physical  nature  of  the  model 
matter.  All  that  does  matter  is  that  it  should  serve  as  a framework 
to  organise  past  and  future  experience”  (Ref.  17). 

It  became  clear  to  the  authors,  aa  the  aeriea  of  experiments  reported  above  was 

being  carried  out,  that  the  model  described  served  admirably  the  function  of 

organising  past  and  future  experience.  The  block-diagram  representation  of  the 

model  of  the  Expected-Value  Observer,  after  Quastler  (Ref.  17),  la  shewn  in 

Figure  17. 


FIG. 17.  BLOCK  DIAGRAM  OF  THE  EXPECTED-VALUE  OBSERVER 
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The  same  diagram  applies  to  the  Heyman-Pearson  Observer  when  the  input  to 


the  criterion  computer  (P(SIf),  V's,  and  K's)  is  replaced  by  PR(Ate))  * k. 
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In  the  case  of  the  A posteriori  Observer,  there  is,  of  course  , no  criterion  com- 


puter, and  the  decision  computer  is  replaced  by  a computer  which  makes  the  trans- 


formation from  i(x)  to  PX(SR),  having  ;(x)  and  P(SIf)  as  input  and  Px(Slf)  as  out- 


put. To  represent  the  forced-choice  situation,  the  criterion  computer  is  elimi- 


nated, and  the  decision  cooputer  merely  selects  the  greatest  of  the  input  likeli- 


hood ratios  as  its  output. 


Each  of  the  five  experiments  reported  above  demonstrates  that  the  human 


observer  (operates  with  information  in  the  form  of  likelihood  ratio,  tends 


toward  optimum  behavior.  These  experiments  provide  convincing  evidence  of  the 


applicability  of  the  proposed  model  to  the  problems  of  visual  detection.  Hie  rele- 


vance of  the  model  is  also  supported  by  its  congruence  with  auditory  data  (Ref. 


26).  There  is,  however,  still  another  imposing  reason  for  treating  sensory  prob- 


lems in  terms  of  the  model,  namely,  that  the  model  provides  a unification  of  the 


data  obtained  with  forced-choice  and  yes-no  methods  of  response.  If  psychophysics 


data  is  collected  and  analysed  in  accordance  with  this  model,  performance  in  the 


forced-choice  situation  can  be  preilcted  from  yes-no  data,  aral  vice  versa.  Evi- 


dence presented  elsewhere  (Refs.  22,  25)  shows  that  the  estimates  of  d'  from  the 


two  response  procedures  are  highly  consistent. 


It  is  interesting  to  note,  parenthetically,  that  the  present  account  is 


not  among  the  first  to  model  psychophysical  theory  after  developments  in  the  theory] 


of  statistical  decision.  Pechner,  the  founder  of  psychophysics,  was  appreciably 


influenced  by  Benoulli  who  first  suggested  computing  expectations  in  terme  of 


satisfaction  units.  As  Boring  (Ref.  5)  relates  the  story,  Bernoulli's  interest 


in  games  of  chance  led  him  to  formulate  the  concept  of  "mental  fortune";  a change 
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in  mental  fortune  be  believed  to  very  with  the  ratio  that  the  change  In  physical 
fortune  has  to  the  total  fortune.  This  mathematical  relation  between  nental  end 
physical  terns  was  the  relation  that  Fecbner  sought  to  establish  vrlth  his  psycho- 
physics. 

6.1  The  Possibility  of  a Threshold  Theory 

It  will  be  well  to  consider  again,  after  the  presentation  of  the  data, 
the  possible  validity  of  a theory  incorporating  the  threshold  concept.  It  is 
clear  that  the  assumption  of  a threshold  as  previously  conceived,  one  that  is  very 
rarely  exceeded  by  nolee  alone,  Is  not  reasonable.  At  this  tine,  however,  the 
existence  of  a threshold  well  down  into  the  noise  distribution  cannot  be  dis- 
credited. To  take  a single  example,  the  data,  representing  values  of  P^(a)  above 
a point  between  .10  and  .30,  that  are  fitted  to  the  R.O.C.  curves  in  Figures  7 
through  10  may  be  adequately  fitted  by  a straight  line  through  Pgg(A)  - Pg(A)  - 
1.0;  these  data,  then,  do  not  preclude  postulation  of  a threshold  in  the  neighbor- 
hood of  the  mean  of  the  noise  distribution.  Further  analyses  of  the  second-choice 
data,  In  relation  to  thresholds  at  various  levels  in  the  noise  distribution,  are 
being  undertaken  and  will  be  reported  elsewhere  (Ref.  20). 

It  should  be  noted,  however,  that  determination  of  the  level  of  the 
noise  distribution  at  which  a threshold  may  possibly  exist  is  neither  critical 
nor  useful.  A threshold  at  such  a level  is  not  a readily  workable  concept.  The 
primary  virtue  of  a threshold  that  is  rarely  exceeded  by  noise  alone  is  that  it 
facilitates  mathematical  treatment  of  the  lata,  chiefly  by  being  consistent  with 
the  usual  correction  for  chance.  It  has  been  demonstrated  above,  however,  that 
mathematical  manipulations  must  not  Involve  assusptions  incompatible  with  a noise 
distribution  much  of  which  exceeds  a threshold,  if  a threshold  is  to  be  postu- 
lated; at  this  point  then,  adhering  to  a threshold  concept  complicates  the 
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math— atlcs.  Am  a matter  of  foot,  a threshold  at  a level  vail  within  the  range 
of  thu  noise  distribution,  is,  for  all  practical  purposes,  not  measurable.  The 
forced-choice  methodology  is  a case  in  point;  the  observer  conveys  less  informa- 
tion than  be  is  capable  of  conveying  if  only  a first  choice  is  required.  Shat  the 
second  choice  contains  a significant  amount  of  information  has  been  demonstrated; 
it  •<<!  not  unlikely  that  the  third  choice  will  convey  information.  Thus  it  is 
very  difficult  for  an  experimenter  to  determine  when  enough  information  has  been 
extracted  from  forced  choices  to  yield  a sufficiently  low  estimate  of  the  thresh- 
old. In  addition,  the  existence  of  such  a threshold  la  of  no  consequence  to  the 
j | application  of  the  theory  proposed  here;  to  take  an  example,  "yes-no"  data  re- 

stilting  from  a suprathreehold  operating  level  depends  on  the  operating  level  but 
is  completely  independent  of  the  threshold  value. 

6.2  Some  replications  of  the  Proposed  Model  for  Psychological  Theory 

The  applicability  of  the  model  provided  by  the  theory  of  signal  detecta- 
bility stance  in  opposition  to  the  view  that  the  so-called  sensory  phenoemna  are 
Independent  of  control  by  general  psychological  variables,  a view  that  is  consis- 
tent with  the  concept  of  the  threshold.  The  theory  built  upon  this  model  takes 
into  account  the  influence  on  detection  behavior  of  "non-eensory"  central  deter- 
minants. 

In  conventional  theory,  the  decision  concerning  the  existence  of  a sig- 
nal is  assumed  to  depeul  entirely  upon  the  threshold  being  exceeded,  and  the 
threshold  level  la  assuasd  to  be  independent  of  control  by  other  variables  that 
night  influence  the  attitude  or  set  of  the  observer.  A successful  application  of 
the  theory  of  signal  detectability  to  psychophysical  data  leads  to  the  replace- 
ment of  the  threshold  concept  by  s concept  of  criterion  range  of  acceptance;  the 
way  In  which  the  control  of  this  range  Is  conceptualised  acknowledges  the  rele- 
vance of  variables  that  influence  set. 

— ^ 
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\ In  the  framework  of  a statistical  theory,  it  is  necessary  to  make  an  as- 

| sumption  which  permits  the  definition  of  behavior,  or. the  prescription  of  predic- 

r ted  behavior.  The  concept  of  the  threshold  has  served  this  purpose.  The  assunp- 

| tion  that  the  threshold  < s relatively  invariant  permits  making  predictions  which 

| can  be  tested  experimentally.  In  the  theory  presented  here,  where  the  position  of 

I the  cutoff  between  acceptance  and  rejection  of  the  existence  of  a signal  (the  oper- 

f atlng  level)  is  assused  to  be  under  the  control  of  the  observer,  it  is  necessary 

I 

■ to  define  the  method  of  control  exerted  by  the  observer  on  the  operating  level. 

- The  assumption  that  the  observer  tends  toward  the  optimum  behavior  provides  the 

| necessary  definition.  Thus,  in  the  typical  yes-no  experiment,  the  observer  may  be 

conceived  of  as  regulating  the  operating  in  terms  of  a priori  probabilities 

and  the  values  and  coats  associated  with  the  various  types  of  correct  and  incorrect 
answers,  in  such  a way  as  to  maximize  the  total  expected  gain.  (It  should,  per- 
haps, be  pointed  out  that  these  values  and  costa  do  exist  in  the  typical  yes-no 

experiment,  whether  o"  not  they  are  explicitly  translated  into  nuaerical  values). 

i 

In  the  forced-choice  experiment,  optimum  behavior  requires  that  no  operating  level 

[ be  assumed,  and  that  the  Interval  with  the  greatest  associated  observation  be  se- 

l 

[ lected.  Although  there  has  been  a general  discontent  among  psychologists  with  the 

concept  of  a fixed  operating  level  or  threshold,  there  has  not  been  advanced  pre- 
viously a way  of  defining  the  mode  of  control  exerted  by  the  individual  over  a 
variable  operating  level,  it  is  the  chief  virtue  of  the  model  provided  by  the 
theory  of  signal  detectability  that  it  specifies  operating  level  variability. 

6.3  Some  Implications  for  Practice 

The  results  of  these  experiments,  of  the  Expected-Value  experiments  in 
particular,  give  an  account  for  Blackwell's  (Ref.  3)  finding  that  forced-choice 
data  are  more  reliable  than  yes-no  data.  In  the  yes-no  experimental  setting,  when 
the  usual  caution  against  making  false -alarm  responses  is  included,  the  operating 
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level  may  vary  over  a wide  range,  with  the  variation  having  no  direct  reflection 
in  the  data.  False -alarm  ratee  of  .01,  .001,  and  .0001,  for  example.  are  net  dis- 
criminable  in  an  experimentally  feasible  number  of  observations.  This  fact  may 
also  account  for  the  failure  to  detect  previously  the  operation  of  a mechanism 
with  a variable  operating  level. 

The  results  presented  above  account  also  for  the  often- reported^  finding 
tha*-  the  forced-choice  procedure  yields  lower  calculated  thresholds  than  does  the 
yes-no  procedure.  Conventionally,  observers  are  cautioned  against  making  false- 
alarm  responses  in  yes-no  experiments.  It  is  very  likely  that  the  btigna  attached 
to  "hallucinating"  serves  to  depress  Pn(a)  in  those  test  settings  not  including  an 
explicit  warning  to  avoid  false  alarms.  The  inverse  relationship  between  Pr(A) 
and  calculated  threshold  predicted  by  the  theory  of  signal  detectability  is  dis- 
cussed in  Reference  25.  Data  substantiating  this  predicted  relationship  include 
the  correlations  reported  shove  and  in  Reference  25  between  Pj^(A)  and  calculated 
threshold,  and  that  shown  in  Figure  5 above.  Plots  of  Pg^A)  vs.  Pjj(a)  which  do 
not  fit  a straight  line  through  Pa|{A)  - P^A)  - 1.00(such  as  in  Figures  7-10) 
provide  another  way  of  saying  the  same  thing.  The  relationship  between  d.'  and 
Pm(A)  at  "threshold"  la  described  in  more  detail  la  the  forthcoming  paper  on 
methods  (Ref.  20). 

In  spite  of  the  view  that  "sensory"  phenomena  are  perlpharally  deter- 
mined, the  necessity  of  assuming  a constancy  of  "set"  across  people  and  over  time 
in  psychophysical  experiments  has  been  generally  accepted.  Effecting  this  con- 
stancy Is  a primary  function,  at  least  in  the  yes-no  experiments,  of  the  verbal 
Instructions.  The  theory  of  signal  detectability  and  tbs  sxperlments  reported 
have  advanced  a check  on  the  assumption  of  constancy  of  set  with  respect  to  the 
most  iu^>ortnnt  aspect  of  set  in  yee-no  experiments,  namely,  the  location  of  the 

17  See,  for  exasple,  Elackwell  (Ref.  3)  and  Goldi«aond  (Ref.  9).  Killer  (Ref.  12) 
rcviavs  earlier  literature  on  “subllminsu  perception"  that  is  relevant  to  this 
point. 
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cutoff  between  acceptance  and  rejection  of  the  existence  of  a a 1 goal.  Thia  re- 
search has  demonstrated  that  a measurable  estimate  of  Pg(A)  can  be,  and  should  be, 
produced  in  yes-no  experiments.  By  the  same  token,  theoretical  support  has  been 
provided  for  the  advisability  of  using  the  forced-choice  procedure  whenever  pos- 
sible. With  this  technique,  the  observer  is  not  faced  with  the  problem  of  locat- 
ing and  maintaining  the  stability  of  an  operating  level,  and  thus  a source  of 
variance  In  the  data  is  removed.  Since  a method  for  unifying  forced-choice  and 
yes-no  data  has  been  provided  (Refs.  22,  25),  forced-choice  techniq  can  be  used 
even  when  an  estimate  of  performance  in  the  yes-no  situation  is  desired.  The  prac- 
tical import  of  this  is  that  data  pertinent  to  yes-no  situations,  that  is  more  re- 
liable, can  be  obtained  with  greater  economy.  This  topic  is  treated  in  more  de- 
tail in  the  paper  on  methods  (Ref.  20). 

That  the  condition  of  the  organism  affects  perception  has  been  demon- 
strated previous  to  the  studies  reported  here.  The  theory  of  Asms  end  his  co- 
workers  (Ref.  1),  the  "new  look"  theory  of  Bruner  and  Postman  (Ref.  6),  and  the 
theories  of  Hebb  (Ref.  ll),  Brunawlk  (Ref.  7),  and  Woodworth  (Ref.  29)  have  taken 
into  account  the  effect  of  "non -sensory"  central  determinants.  Tbs  present  ac- 
count, however,  goes  beyond  the  stags  of  demonstration;  it  provides  operational 
and  theoretical  specifications  of  the  "conditions"  The  present  account,  then, 
satisfies  the  desiderata  discussed  by  Oraham  (Ref.  10):  the  conditions  of  the 
organism  arc  specified  at  other  than  the  conversational  level;  tbs  conditions  are 
defined  in  the  theory  and  anchored  to  operations  at  both  ends.  Since  the  variables 
which  determine  these  conditions  are  expressed  quantitatively,  the  quantification 
of  a*  important  group  of  Instruction  stimuli  has  been  achieved.  Said  another  way, 
this  research  proceeds  a step  in  the  direction  of  specifying  conditions  of  the 
organism,  due  to  Instructions , as  parasmters  of  observable  stimulus -re spouse 
relations . 
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